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Abstract 

We study the problem of finding a small sparse cut in an undirected graph. Given an undirected 
graph G = (V,E) and a parameter k < \E\, the small sparsest cut problem is to find a set S C V 
with minimum conductance among all sets with volume at most k. Using ideas developed in local graph 
partitioning algorithms, we obtain the following bicriteria approximation algorithms for the small sparsest 
cut problem: 

• If there is a set U C V with conductance <j> and vol((7) < k, then there is a polynomial time 
algorithm to find a set S with conductance 0(\/4>je) and vol(S) < fc 1+e for any e > 1/k. 

• If there is a set U C V with conductance <f> and vol([/) < k, then there is a polynomial time algorithm 
to find a set S with conductance 0{\J '^logfc / 'e) and vol(5') < (1 + t)k for any e > 21nfc/fe. 

These algorithms can be implemented locally using truncated random walk, with running time almost 
linear to the output size. This provides a local graph partitioning algorithm with a better conductance 
guarantee when k is sublinear. 

1 Introduction 

For an undirected graph G = (V, E), the conductance of a set S C V is defined as 4>(S) = \S(S)\/v6l(S), where 
5(S) is the set of edges with one endpoint in S and another endpoint in V — S, and vol(5) = X^eS 
where d(v) is the degree of v in G. Let n — \V\ and m = \E\. The conductance of G is defined as 
4>{G) = min< ? . vo i^ <m 4>{S). The conductance of a graph is an important parameter that is closely related 
to the expansion of a graph and the mixing time of a random walk [S] . Finding a set of small conductance, 
called a sparse cut, is a well-studied algorithmic problem that has applications in different areas. Several 
approximation algorithms are known for the sparsest cut problem. The spectral partitioning algorithm 
by Cheeger's inequality [6l [TJ finds a set of of conductance y/ <f){G) with volume at most m. The linear 
programming rounding algorithm by Leighton and Rao [9] finds a set of conductance 0((f>(G) log(n)) with 
volume at most m. The semidefinite programming rounding algorithm by Arora, Rao and Vazirani [3] finds 
a set of conductance 0(<f>(G)y/\og(n)) with volume at most m. 

Recently there has been much interest in studying the small sparsest cut problem, to determine <pk(G) = 
min S vo j ( . s , |<fe <f>(S) for a given k, and to find a set of smallest conductance among all sets of volume at most 
k. This is also known as the expansion profile of the graph jlO[ 113]. There are two main motivations for this 
problem. One is the small set expansion conjecture [12], which states that for every constant e > there exists 
a constant S > such that it is NP-hard to distinguish whether <frs m (G) < e or <ps m {G) > 1 — e. This conjec- 
ture is shown to be closely related to the unique games conjecture |12j , and so it is of interest to understand 
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what algorithmic techniques can be used to estimate <fik(G). There are bicriteria approximation algorithms 
for this problem using semidefinite programming relaxations: Raghavendra, Steurer and Tetali [13] obtained 
an algorithm that finds a set S with vol(5) < 0(k) and <j>(S) < 0(y / 4>k(G) log(m/fc)), and Bansal et.al. [5] 
obtained an algorithm that finds a set S with vol(S') < (1 + e)fc and 4>(S) < 0(f(e) <fik (G) ylog n \og(m/k)) 
for any e > where /(e) is a function depends only on e. 

Another motivation is the design of local graph partitioning algorithms in massive graphs. In some situations, 
we have a massive graph G — (V, E) and a vertex v £ V, and we would like to identify a small set S with 
small conductance that contains v (if it exists) . The graph may be too big that it is not feasible to read the 
whole graph and run some nontrivial approximation algorithms. So it would be desirable to have a local 
algorithm that only explores a small part of the graph, and outputs a set S with small conductance that 
contains v, and the running time of the algorithm depends only on vol(S') and polylog(n). All local graph 
partitioning algorithms are based on some random walk type processes. The efficiency of the algorithm 
is measured by the work/volume ratio, which is defined as the ratio of the running time and the volume 
of the output set. Spielman and Teng [T3] proposed the first local graph partitioning algorithm using 
truncated random walk, that returns a set S' with 4>(S') — 0((p 1 ^ 2 (S) log 3 / 2 n) if the initial vertex is a 
random vertex in S, and the work/volume ratio of the algorithm is 0(<j)~ 2 (S) polylog(n)). Anderson, Chung, 
Lang |J| used local pagerank vectors to find a set S' with <j)(S') — 0(y / (j)(S) log/c) and work/volume ratio 
0((j)~ 1 (S) polylog(n)), if the initial vertex is a random vertex in a set S with vol(S') = k. Anderson and 
Peres |3] used the volume-biased evolving set process to obtain a local graph partitioning algorithm with 
work/volume ratio 0{4>^ 1 ^ 2 polylog(n)) and a similar conductance guarantee as in [2J. Note that the running 
time of these algorithms would be sublinear if the volume of the output set is small, which is the case of 
interest in massive graphs. 

1.1 Main Results 

We show that the techniques developed in local graph partitioning algorithms |14[ [7] can be used to obtain 
bicriteria approximation algorithms for the small sparsest cut problem. We obtain a tradeoff between the 
conductance guarantee and the volume of the output set. 

Theorem 1.1. Given an undirected graph G — (V,E) and a parameter k, there is a polynomial time 
algorithm to do the following: 

1. Find a set S with 4>{S) = 0(y/^ k {G)/e) and vol(S) < k 1+e for any e > 1/k. 

2. Find a set S with 4>(S) = 0{^/4>k{G) logfc/e) and vol(S) < (1 + e)k for any e > 21nfc/fc. 

For the small sparsest cut problem, when k is sublinear (fc = 0(m c ) for c < 1), the performance guarantee 
of the bicriteria approximation algorithm in Theorem ll.lf 2) is similar to that of Raghavendra, Steurer and 
Tetali [13]. Also, when k is sublinear, the conductance guarantee of Theorem 11.1( 1) is independent of n, 
which matches the performance of spectral partitioning while having a bound on the volume of the output 
set. These show that random walk algorithms can also be used to give nontrivial bicriteria approximations for 
the small sparsest cut problem. Moreover the algorithms can be implemented locally by using the truncated 
random walk algorithm. 

Theorem 1.2. For an undirected graph G = (V, E) and a set U C V , given 4> > 4>(U) and k > vol(U), there 
exists an initial vertex such that the truncated random walk algorithm can find a set S with 4>(S) ^ 0(a/ 4>/e) 
and vol(S) < 0(k 1+t ) for any e > 2/k. The work/volume ratio of the algorithm is 0(k' L (j)^ 2 ). 

When k is sublinear, the interesting case of local graph partitioning algorithms, the conductance guarantee 
of Theorem 11.21 matches that of spectral partitioning, improving on the conductance guarantees in previous 
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local graph partitioning algorithms. However, we note that our notion of a local graph partitioning algorithm 
is much weaker than previous work |14( 2, 3], where they proved that a random initial vertex u will work 
with a constant probability. We only prove that there exists an initial vertex that will work, and unable to 
prove the high probability statement. 

In Section 4 we discuss a connection to the small set expansion conjecture. 
1.2 Techniques 

The techniques are from the work of Spielman and Teng Q3] and Chung [TJ. Our goal in Theorem 11.1( 1) 
is equivalent to distinguish the following two cases: (a) there is a set S with vol(S) < k and <j>(S) < <p, 
or (b) the conductance of every set of volume at most ck is at least £1(^/0) for some c > 1. As in |14) . 
we use the method of Lovasz and Simonovits [11] that considers the total probability of the k edges with 
largest probability after t steps of random walk, call this number Ct(k). In case (a), we use the idea of 
Chung [7j that uses the local eigenvector of S of the Laplacian matrix to show that there exists an initial 
vertex such that Ct(k) > (1 — In case (b), we use a result of Lovasz and Simonovits [TT] to show that 
C-t(k) < - + y/k(l — MtfY for a large enough constant M, no matter what is the initial vertex of the random 
walk. Hence, say when c > fc 001 , by setting t = 0(log k/ if), we expect that Cj(fc) is significantly greater 
than 1/c in case (a) but at most 1/c plus a negligible term in case (b), and so we can distinguish the two 
cases. To prove Theorem ll.2f 1). we use the truncated random walk algorithm as in [14] to give a bound on 
the work/volume ratio. Theorem II .1( 2) is a corollary of Theorem II .1( 1). 

2 Finding Small Sparse Cuts 

The organization of this section is as follows. First we review some basics about random walk in undirected 
graphs. Then we present our algorithm in Theorem 11.11 and the proof outline, and then we present the 
analysis and complete the proof of Theorem 11.11 

2.1 Random Walk 

In the following we assume G = (V, E) is a simple unweighted undirected connected graph with n — \V\ 
vertices and m = \E\ edges. Our algorithms are based on random walk. Let po be an initial probability 
distribution on vertices. Let A be the adjacency matrix of G, D be the diagonal degree matrix of G, and 
W = ^(1 + D~ 1 A) be the lazy random walk matrix. The probability distribution after t steps of lazy random 
walk is defined as p t — poW . (For convenience, we use pt to denote a row vector, while all other vectors by 
default are column vectors.) For a subset S C V, we use pt(S) to denote J2ues Pt( u )- 

To analyze the probability distribution after t steps of lazy random walk, we use the method developed 
by Lovasz and Simonovits [IT] as in other local graph partitioning algorithms [T31 [2] • We view the graph 
as directed by replacing each undirected edge with two directed edges with opposite directions. Given a 
probability distribution p on vertices, each directed edge e = uv is assigned probability q(e) = p(u)/d u . 
Let e\, 62, ■ ■ ■ , eim be an ordering of the directed edges such that q(e\) > qfa) > ■ ■ ■ > <l{&2m)- The curve 
introduced by Lovasz and Simonovits C : [0, 2m] — > [0, 1] is defined as follows: for integral x, C(x) = 
Si=i?( e *)' f° r fractional x — \x\ + r, C(x) = (1 — r)C([x\) + rC(\x~\). Let G t be the curve when the 
underlying distribution is pt- Let v±, i>2, • ■ • , v n be an ordering of the vertices such that pt(v\) / d(vi) > 
Pt(v2)/d{v 2 ) > ■ > Pt(v n )/d(v n ). Then C{(Xh=i d ( v i)) = J2i=iPt( v i) for all j € [n]. We call the points 
Xj = Yli=i d(vi) extreme points, and note that the curve is linear between two extreme points. We also call 
the sets S t j = . . . , vj} for 1 < j < n the level sets at time t. 
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The curve Ct is concave, and it approaches the straight line x/(2m) when p t approaches the stationary 
distribution. Lovasz and Simonovits analyzed the convergence rate of this curve to the straight line 
based on the conductances of the level sets. 

Lemma 2.1 (Lovasz-Simonovits [lljl. Let x — Xj < m be an extreme point at time t and S — Stj be the 
corresponding level set. If faS) > f, then Ct(x) < |(Cj_i(x — <fx) + Ct-i(x + <fx)). 



2.2 Algorithm 

Our algorithm is simple. For each vertex v, we use it as the initial vertex of the random walk, and compute 
the probability distributions pt for 1 < t < 0(n 2 \nn). Then we output the set of smallest conductance 
among all level sets Stj (of all initial vertices) of volume at most ck, where in Theorem II .11 1) we set c = fc E 
and in Theorem II. If 2) we set c = 1 + e. Clearly this is a polynomial time algorithm. 

To analyze the performance of the algorithm, we give upper and lower bound on the curve based on the 
conductances. On one hand, we use Lemma 12.11 to prove that if all level sets of volume at most ck are of 
conductance at least fa, then the curve satisfies C t (x) < ft(x) := J| + y/x(l — for all x < k. Informally, 
this says that if fa is large, then Ct(k) is at most 1/c plus a negligible term when t is large enough. This 
statement holds regardless of the initial vertex of the random walk. On the other hand, if there exists a set S 
of volume at most k with conductance fa, then we use the idea of Chung [7] that uses the local eigenvector of 
S of the Laplacian matrix to show that there exists an initial vertex for which Ct(fc) > (1 — 4r)*. Informally, 
this says that if fa is small, then Ct(k) is significantly larger than 1/c if c is large. Finally, by combining the 
upper and lower bound for Ct(k) and choosing an appropriate t, we show that fa < 0(^/fa) when c = k e and 
fa < 0(\/fa Ink) when c = 1 + e. Hence the algorithm can find a level set with the required conductance. 



2.3 Upper Bound 

We prove the upper bound using Lemma 12.11 We note that the following statement is true for any initial 
probability distribution, in particular when pq = \ v for any v. 

Theorem 2.2. Suppose for all t' < t and i € [n], we have faSt> t i) > fawhenever vol(Sf.i) < I < m. Then 

,2 

the curve satisfies Ct{x) < ft(x) := f + \/x(l — for all x < I. 

Proof. Let the extreme points Xi satisfy = xo < x\ < X2 < • • • < xi < I < x<+i. Note that C't is linear 
between extreme points and between x% and I, and ft is concave. So we only need to show the inequality for 
extreme points and the point I. At the point x — I, the inequality always hold as ft{l) > 1 > C*(0 for any t. 
Now we would prove by induction. When t = the inequality is trivial as fo(x) > 1 > Co (a;) for all a; > 1. 
When t > and x is an extreme point, 

C t {x) < -(C t -i(x - fax) + C t -i(x + fax)) (by Lemma EU) 

< -^{ft-x{x-fax) + ft-x{x + fax)) (by induction) 
1 



= j + 5V^(i-fr 1 ( A /wr+ v TT^) 



where the last inequality follows from Taylor expansions of \/\ — fa and yl + fa. □ 
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2.4 Lower Bound 



The idea is to use the local eigenvector of S of the normalized Laplacian matrix to show that there is an 
initial distribution such that Pt(S) > (1 — 

Theorem 2.3. Assume S C V where vol(S) < m and 4>{S) < 4>2- Then there exists a vertex v such that if 
Po = Xv,thenp t (S)>(l-fy. 

Proof. Let C = LD~? be the normalized Laplacian matrix, where L = D — A is the Laplacian matrix 
of the graph. For any matrix M with rows and columns indexed by V, let Ms be the \S\ x l^l submatrix of 
M with rows and columns indexed by the vertices in S. Consider the smallest eigenvalue As of Cs and its 
corresponding eigenvector vs- Let \S be the characteristic vector of S. We have 

{Dll) T C s {D}l) = i T Lsl= (xs(u)-xs(v)) 2 = \S(S)\. 

e=uv£E 

So, by the Courant-Fischer theorem, 

(4l) r £s(j|l) \S(S)\ 

AS < — = 77^7 < 02- 

IPIilll MS) 

We assume without loss of generality that S is a connected subgraph. Then, by the Perron-Frobenius 

theorem, the eigenvector vs can be assumed to be positive, and we can rescale vs such that ||Z?5t>s||i = 1 is 
a probability distribution. Let p t .s denote the restriction of pt on S. We set the initial distribution po such 

that po^s = {DgVs) T , and poy-s — 0. We would show that p t ,s > (1 — ^f-)*Po,s by induction. Clearly the 
statement is true when t = 0. For t > 0, we have 

Pt,s > Pt-i.sWs 

(Is + Ds'As) 



Therefore, 



= Pt-i,s ■ 

> + (by induction) 

= (1-^)^(1-^1 

= (1-^)^1 

= (i-^)W 



pt(5) = K ,s(5) > (1 - ^)W(S) > (1 - y 



Since random walk is linear and «s is a convex combination of Xv where v G 5, there exists a vertex »£S 

2 



such that if po = Xt>, then pt(S') > (1 — %)*• □ 



2.5 Proof of Theorem flTTI 

We combine the upper bound and the lower bound to prove Theorem 11.11 We note that Theorem 11.11 is 
trivial if (j>k(G) > e, and so we assume <j>k(G) < e. We also assume e < 0.01, as otherwise we reset e = 0.01 
and lose only a constant factor. 
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The algorithm is simple. Set T = efc 2 lnfc/4. For each vertex u, set po = Xu and compute St : i for all t < T 
and i £ [n]. Denote these sets by St^u to specify the starting vertex u. Output a set S = St,i. u that achieves 
the minimum in min vo j^ )<j.i+ e 0( , 5 , t,i,ii)- Clearly the algorithm runs in polynomial time. 

We claim that 4>(S) < Ay/ <pk{G) / e. Suppose to the contrary that the algorithm does not return such a set. 
Consider t = 2 ^°^ ; note that t < T as <fik{G) > 1/k 2 for a simple unweighted graph. Applying Theorem l2.2l 
with I = fc 1+E , for any starting vertex u, we have 

cm < ^ + Vkd-2^1y 

< ^ + v^exp(-2^-^) 
e 20 fc (G) 

= fc~ c + vfcexp(— Ink) 

= k~ £ + k~^. 

On the other hand, suppose S* is a set with vol(5*) < k and <fi(S*) = <pf.(G). Then Theorem 12.31 savs that 
there exists a starting vertex u* £ S* such that 

ms*) > d-M^r 

> exp(-0 fe (G)t) (for fc (G) < 0.01) 
= exp(— -eln/c) 

= fc-* 

> fc~ e + /c~5 (f or k > - and e < 0.01) 

This is contradicting since Ct(k) > pt(S*) for that starting vertex, completing the proof of Theorcm ll.lf 1). 

Now we obtain Theorem EH 2) as a corollary of Theorem [TTTlV Set e' = j^. Then fc 1+e ' < (1 + e)k. By 
using Theorem EHl) with e', we have Theorem EH2). 



3 Local Graph Partitioning 

To implement the algorithm locally, we use truncated random walk as in |14j . Let qo = Xv- For each t > 0, 
we define pt by setting pt(v) = if qtiy) < ed(v) and setting pt(v) = qt(v) if qt(v) > erf(w), and we define 
9t+i = PtW. Then, we just use pt to replace pt in the algorithm in Section [2] To prove that the truncated 
random walk algorithm works, we first show that pt is a good approximation of pt and can be computed 
locally. Then we show that the curve defined by p t satisfies the upper bound in Theorem 12.21 and it almost 
satisfies the lower bound in Theorem 12. 31 Finally we combine the upper bound and the lower bound to prove 
Theorem El 

3.1 Computing Truncated Distributions 

Lemma 3.1. There is an algorithm that compute pt such that pt < pt < Pt(v) + etd for every < t < T , 
with time complexity 0(T/e), where d is the degree vector. 

Proof. First we prove the approximation guarantee. By induction, we have the upper bound 

Pt < qt = Pt-iW < pt-iW = p t . 
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Also, by induction, we have the lower bound 



Pt = Pt-iW < (pt-i + e(t - l)d)W = q t + e(t - l)d < p t + etd. 

Next we bound the computation time. Let St be the support of pt- In order to compute qt+i from p t , we 
need to update each vertex v € St and its neighbors. Using a perfect hash function, the neighbors of a vertex 
v can be updated in 0{d(v)) steps, and thus qt+i and pt+i can be computed in 0(vol(S' t )) steps. Since each 
vertex v € St satisfies pt > ed(v), we have vol(5t) = J2ves t d{ v ) — Pti^t)l e — l/ e > an d this completes the 
proof. □ 



3.2 Approximate Upper Bound 

We use the truncated probability distributions to define the curve Ct ■ Note that pt may not be a probability 
distribution and C((2m) may be less than one. And we define the level sets St,i = {ui,«2, ■ • ■ when 
we order the vertices such that pt{v\)/d{v\) > Pt(v2)/d(v2) > ■ ■ ■ > Pt{v n )/ d{v n ). We show that C t would 
satisfy the same upper bound as in Theorem 12.21 

Lemma 3.2. Suppose for all t < T and i € [n], we have (f>{St,i) > <fti whenever vol(St,i) < I < m. Then 
C t (x) < f t (x) := f + v^(l - f )* for all x < I. 

Proof. Let £j = X^^GSt ^ e ex treme points defined by pt'- By the same proof as in Theorem 12.21 

it suffices to prove that Lemma 12.11 still holds after replacing p t by pt ■ It means that we need to show if 
x = Xi < m is an extreme point (at time t), S = S t j is the corresponding set of vertices and vol(5) > <p, 
then C t {x) < \{C t -i{x — 4>x) + C t -i(x + <f>x)). This is true since the curve defined by q t = Pt-iW is less 
than h(C t -i(x — (j)x) + C t -i(x + 4> x )) by Lemma I2TT1 and p t < qt- □ 

3.3 Proof of Theorem flT2l 

Suppose U is a subset of vertices with vol(U) < k and <fi{U) < <p, where | < k < m. We would prove that 
given k and <p and an initial vertex u in U with pt{U) > -(1 — for a constant c > 1, the truncated 
random walk algorithm will output a set S with vol(S') < 0(k 1+t ) and <f>(S) < By/ipje. The running time of 
the algorithm is 0(e 2 k 1+2e In 3 k/ip 2 ). 

For concreteness we set c = 4 in the following calculations. Set T — and e' = fc 20T . Applying Lemma 

13.11 with T and e', we can compute all pt and thus St,i for all t < T and i € [5fc 1+£ ] in 0(Thxk/e') — 
0(e 2 fc 1+€ In 3 k/ip 2 ) steps (with an additional lnfc factor for sorting). By Lemma f3.1[ the starting vertex u 
will give p T (U) > \{l - f ) T - e'Tvo\(U). We claim that one of the set S = S t ,i must satisfy vol(S) < 5fc 1+e 
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and 4>(S) < Otherwise, setting cf>\ > 8\/tp/e, we have 

Pt(U) > J(l-|) T - e 'Tvol(L7) 

> ~exp(-^T)--|^ (for 0< 0.01) 



> 
> 



4 20 

1 e 1 1 

h kr 5 (using k~i > k~ e + 4fc~2 for k > - and e < 0.01) 

5 e 



r(*), 

which is a contradiction, completing the proof of Theorem 11.2 



5k 1 
> C T (k), 



4 Concluding Remarks 

We presented a bicriteria approximation algorithm for the small sparsest cut problem with conductance 
guarantee independent of n, but the volume of the output set is k 1+e . We note that if one can also guarantee 
that the volume of the output set is at most Mk for an absolute constant M, then one can disprove the 
small set expansion conjecture, which states that for any constant e there exists a constant S such that 
distinguishing (f>sm(G) < e and 4>s m (G) > 1 — e is NP-hard. This can be viewed as an evidence that our 
analysis is almost tight, or an evidence that the small set expansion problem is not NP-hard. 

More formally, suppose there is a polynomial time algorithm with the following guarantee: given G with 
4>k(G), always output a set S with <j)(S) = f{4>k{G)) and vol(5) = Mk where f{x) is a function that tends 
to zero when x tends to zero (e.g. f(x) = x 1 / 100 ) and M is an absolute constant. Then we claim that there 
is a (small) constant e such that whenever <^ (G) < e there is a polynomial time algorithm to return a set S 
with (j)(S) < 1 - e and vol(S) < k. 

We assume that G is a d-regular graph, as in [T^] where the small set expansion conjecture was formulated. 
Suppose there is a subset U with \U\ = k and <fi(U) < e. First we use the algorithm to obtain a set S with 
4>{S) ^ /( e ) an d assume \S\ = Mk (instead of |5| < Mk). Next we show that a random subset 5" C S of 
size exactly k will have <j>(S') < 1 — e with a constant probability for a small enough e. Let E(S) be the set 
of edges with both endpoints in S. Each edge in E(S) has probability 2(i)(l — A) to be in S(S'). So, the 
expected value of 

\6(S')\<\6(S)\ + 2(±)(1-±)\E(S)\. 
By construction vol(S') = kd, and so the expected value of 



\S(S)\ , 2(i)(l - 



fcii kd 

Note that < Mkd/2 and 1 5(5) | /fed = M<£(5) < Mf(e), so the expected value of 

0(sr')<M/( e ) + i-JL 

For a small enough e depending only on M, the expected value of 4>(S') < 1 — lOe. Therefore, with a constant 
probability, we have <fi(S') < 1 — e. This argument can be derandomized using standard techniques. 
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We show that random walk can be used to obtain nontrivial bicriteria approximation algorithms for the 
small sparsest cut problem. We do not know of an example showing that our analysis is tight. It would be 
interesting to find examples showing the limitations of random walk algorithms (e.g. showing that they fail 
to disprove the small set expansion conjecture). 
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